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DETAILED ACTION 

1 . The following action is in response to the Request for Continued Examination (RCE) 
filed under 37 CFR 1 .53(d) for the instant application on August 26, 2008. AppUcants have 
properly set forth the RCE, which has been entered into the application. Accordingly, the 
amendment submitted August 26, 2008, has been entered and an examination on the merits 
follows herewith. 

2. Claims 2, 6-7, 10-22, 25-27, and 29-30 have been canceled. Claims 1, 3-5, 8-9, 23-24, 
and 28 are pending and have been considered below. 

Claim Rejections - 35 USC § 103 

3. The following is a quotation of 35 U.S. C. 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 1 02 ol' this title, if the differences between the subject matter sought to be patented and the prior art are 
such thai the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

4. Claims 1, 3-5, 8-9, and 23-24 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Hashimoto et al., "Tele-Handshake through the Intemet", IEEE Workshop on Robot and 
Human Communication, copyright 1996 IEEE, pages 90-95, previously presented as 

" Hashimoto ", in view of Cohen et al. (US 7,036,094), previously presented as " Cohen ". 
Claim 1 : Hashimoto discloses a method of communicating physical human interactions over a 
communications network (page 90 col 2 lines 4-8) comprising: 
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detecting physical contact with a first model by a first user located at a sending system (page 
90 col 2 "Tele-Handshaking System" paragraphs 1 and 2, tactile feedback, Operator A, site 
A), said first model representing at least a portion of a human body (page 91 Fig. 2), wherein 
said first model incorporates one or more contact sensors (page 91 Fig. 2);. 
generating data from said sensors specifying the physical contact (page 90 "Tele- 
Handshaking System" paragraph 4); 

determining at least one action intended by the generated data (page 90 "Tele-Handshaking 
System" paragraph 4); 

transmitting the determined action over a communications network to a receiving system 
(page 91 paragraph 1); and 

simulating the action by performing said action on a second user at the receiving system 
using a second model (page 90 "Tele-Handshaking System" paragraph 2), said second model 
representing at least said portion of said human body (page 91 Fig. 2), wherein said second 
model incorporates one or more actuators (page 91 Fig. 2). 

While Hashimoto discloses that the portion of a human body is a hand and that the physical 
contact in question is a handshake, Hashimoto does not explicitly disclose that the portion of 

a human body includes at least one among a human head, face, back and entire human body; 
nor does Hashimoto disclose that the generated data used in determining an action to be 
transmitted and simulated also includes data gathered from detecting a physical movement of 
the first use using one or more optical sensors, wherein the physical movement includes at 
least one of a body movement and a change in facial expression of the first user, and that this 
additional data causes the second model to activate the detected physical movement. Cohen 



Application/Control Number: 1 0/7 1 5 ,04 1 Page 4 

Art Unit: 2175 

discloses a system for recognizing behaviors as a combination of gestures identified on 
various parts of a human body in motion (Abstract lines 1-3). The various gestures include 
any type of static gestures determined via multiple cameras (col 16 lines 62-63), including 
body portions such as foot, limb and full body gestures (col 16 lines 65-67). The gestures are 
recorded and compared by a behavior program to identify what type of behavior is being 
presented (col 23 lines 43-47). Therefore, it would have been obvious to one having ordinary 
skill in the art and the teachings of Hashimoto and Cohen before them at the time the present 
invention was made, to further expand the physical contact transmission method of 
Hashimoto to include visual identification of various actions using different human body 
portions. One would have been motivated to do this in order to expand the hand-shake action 
of Hashimoto to further include other actions from other body parts, as suggested by Cohen 
(col 16 lines 65-67). 

Claim 3: Hashimoto and Cohen disclose the physical movement transmission and replication 
method as in claim 1 above, but do not explicitly disclose converting the data to markup 
language formatted data. However, Hashimoto discloses operating the method using the TCP 
protocol (page 913.1). As is well known in the art, TCP fransmission involves sending packets 
of data each containing a header and the data. Therefore it would have been obvious to one of 
ordinary skill in the art and having the teachings of Hashimoto and Cohen before them at the 
time the present invention was made, to implement the computer methods as modules and to 
convert the data for fransmission by separating them into packets and placing an identification 
header, i.e. marking up the data based on TCP protocol, in order to help differentiate the data 
packets being received. One would have been motivated to do this in order to use the standard 



Application/Control Number: 10/715 ,04 1 Page 5 

Art Unit: 2175 

mark up language for converting the data for TCP transmission, as suggested by Hashimoto 
(page 913.1. "we have selected to use rehable TCP protocol"), thereby avoiding the cost and 
time involved with developing one's own mark up language and transmission protocol, when 
using Intemet aware applications. 

Claim 4: Hashimoto and Cohen disclose the physical movement transmission and replication 
mark up language method as in claim 3 above, and Hashimoto further discloses identifying the 
action from the markup language formatted data in the receiving system (page 90 "Tele- 
Handshaking System" paragraph 4). 

Claim 5: Hashimoto and Cohen disclose the physical movement transmission and replication 
mark up language method as in claim 4 above, and Hashimoto further discloses wherein the 
markup language formatted data specifies at least one actuator movement to be implemented by 
the receiving system and an amount of force to be applied in the at least one actuator movement 

(page 90 "Tele-Handshaking System" paragraph 4). 

Claim 8: Hashimoto and Cohen disclose the physical movement transmission and replication 
method as in claim 8 above, and Hashimoto fiirther discloses said simulating step further 
comprising the step of translating the action into instructions for activating at least one actuator 
(page 91 Fig. 1 on Operator B Site B: "Host Computer - ISA bus - DA"); and activating the at 
least one actuator in accordance with the instructions (page 91 Fig. 1 on Operator B Site B: "DA 
- Linear Motion Motors - Handshake Device"). 

Claims 9: Hashimoto and Cohen disclose the physical movement transmission and replication 
method as in claim 1 above, and Hashimoto further discloses the method further comprising: 
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detecting physical contact of the second model by a second user (page 90 col 2 "Tele- 
Handshaking System" paragraphs 1 and 2, tactile feedback, Operator B, site B), wherein said 
second model incorporates one or more sensors (page 91 Fig. 2); 

generating data from said sensors specifying the physical contact of the second model (page 

90 "Tele-Handshaking System" paragraph 4); 

determining at least one action intended by the second user indicated by the generated data 
(page 90 "Tele-Handshaking System" paragraph 4); 

fransmitting the determined action over a conmiunications network to the sending system 

(page 91 paragraph 1); and 

simulating the action by performing said action on the first user at the sending system using 
the first model (page 90 "Tele-Handshaking System" paragraph 2), wherein said first model 
incorporates one or more actuators (page 91 Fig. 2). 
Claim 23: Hashimoto and Cohen disclose the physical movement transmission and replication 
method as in claim 1 above, and Hashimoto further discloses wherein said generated data 
specifies a time when a force was detected (page 95 Fig. 7 Operator force, x-axis = time in 
seconds), amount of said force (page 95 Fig. 7 Operator force, y-axis = force in Newtons), and a 
location on said human body to which said force was applied (page 95 Fig. 7 Tele-handshake test 
result, hand). 

Claim 24: Hashimoto and Cohen disclose the physical movement transmission and replication 
method as in claim 1 above, and Hashimoto fiirther discloses wherein said action intended by 
said first user includes at least one among a handshake, an embrace, and a pat on the back (page 
90 "Tele-Handshake through the Internet"). 
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5. Claim 28 is rejected under 35 U.S.C. 103(a) as being unpatentable over Hashimoto and 
Cohen as applied to claims 1,10, and 13 above, and further in view of Oakley. I. and 
O'Modhrain. S. . "Contact IM: Exploring asynchronous touch over distance," Proceedings of 
CSCW, New Orleans, USA, 16-20 November 2002, hereafter known as "Oakley". 
Claim 28: Hashimoto and Cohen disclose the physical movement transmission and replication 
method and computer-readable medium as in claims 1,10 and 13 above respectively, wherein 
human actions are interpreted as behaviors by a physical model and optical sensors and 
transmitted over a network to be actuated by another physical model. Hashimoto and Cohen do 
not explicitly disclose providing a graphical user interface, within said graphical user interface 
said first user can select human actions or processing tasks, wherein said human actions include 
at least one among "touch the face", "touch arm", and "embrace" and said processing tasks 
include at least one of "opening an audio channel" and "opening a video channel". Oakley 
discloses an Instant Messaging system wherein haptic effects can be selected by a first user and 
conveyed via communication network to a second user (page 1 : paragraph 1, paragraph 9). 
Specifically, Oaklev discloses a user selecting, via a GUI, the recipient of a haptic message 
and/or audio or text message (page 2 paragraph 4). Therefore, it would have been obvious to one 
having ordinary skill in the art and the teachings of Hashimoto , Cohen and Oaklev , to combine 
the GUI for selecting and transmitting haptic actions and processing tasks as taught by Oaklev , 
with the physical movement transmission method of Hashimoto and Cohen, to yield a graphical 
user interface for selecting human actions and processing tasks such as opening a video or audio 
channel. One would have been motivated to do this in order to provide an asynchronous instant 
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messaging client with physical movement actuation, as suggested by Oakley (page 1 paragraph 
1). 

Response to Arguments 

6. Applicant's arguments filed August 26, 2008, have been fully considered but they are not 
persuasive. 

Applicant argues, on pages 6-7, that Cohen does not teach or suggest the deficiencies of 
Hashimoto as presented in the rejection of claim 1 above. In particular, Apphcant argues that 
while Cohen discloses generating categorical behavior from recognized human gestures, Cohen 
does not disclose generating data from the recognized gestures and then transmitting those to a 
second model for simulation. The examiner notes, that as shown in the rejection of claim 1 
above, the generation of data from a recognized gesture is already performed by Hashimoto . 
Cohen serves to expand, when combined with Hashimoto , the method of Hashimoto to include 
data gathered from the movement of various hiiman body parts captured via optical sensor. The 
argument is not persuasive. 

In response to applicant's argument that Cohen is nonanalogous art (page 7), it has been held that 
a prior art reference must either be in the field of applicant's endeavor or, if not, then be 
reasonably pertinent to the particular problem with which the applicant was concerned, in order 
to be relied upon as a basis for rejection of the claimed invention. See In re Oetiker, 977 
F.2d 1443, 24 USPQ2d 1443 (Fed. Cir. 1992). In this case, Cohen pertains to recognizing 
human actions through the use of sensors (Abstract), a field of endeavor relied on by the instant 
invention, and is therefore analogous. 



Application/Control Number: 1 0/7 1 5 ,04 1 Page 9 

Art Unit: 2175 

Applicant argues, on page 8, that TCP and mark up language are two completely different 
concepts. The examiner respectfiilly disagrees. As shown in the rejection of claim 3 above, TCP 
transmission protocol requires data packets be assigned a header for identification. Assigning a 
header bit to a group of data bits is marking up the group of data bits. The argument is not 
persuasive. 



Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Andrew Tank whose telephone number is 571-270-1692. The 
examiner can normally be reached on Mon - Thur 0830-1700 EST. 

If attempts to reach the examiner by telephone are unsuccessfiil, the examiner's 
supervisor, William Bashore can be reached on 571-272-4088. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would 
like assistance from a USPTO Customer Service Representative or access to the automated 
information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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Examiner, Art Unit 2175 
October 25,2008 
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